Doubly-Attentive Decoder for Multi-modal Neural Machine Translation

We introduce a Multi-modal Neural Machine Translation model in which a doubly-attentive decoder naturally incorporates spatial visual features obtained using pre-trained convolutional neural networks, bridging the gap between image description and translation. Our decoder learns to attend to source-language words and parts of an image independently by means of two separate attention mechanisms as it generates words in the target language. We find that our model can efficiently exploit not just back-translated in-domain multi-modal data but also large general-domain text-only MT corpora. We also report state-of-the-art results on the Multi30k data set.Comment: 8 pages (11 including references), 2 figure

Technology for Processing Non-verbal Information in Speech

Proceedings of the NODALIDA 2009 workshop Multimodal Communication — from Human Behaviour to Computational Models. Editors: Costanza Navarretta, Patrizia Paggio, Jens Allwood, Elisabeth Alsén and Yasuhiro Katagiri. NEALT Proceedings Series, Vol. 6 (2009), 1-2. © 2009 The editors and contributors. Published by Northern European Association for Language Technology (NEALT) http://omilia.uio.no/nealt . Electronically published at Tartu University Library (Estonia) http://hdl.handle.net/10062/9208

Examining the Relationships Between Education, Social Networks and Democratic Support With ABM

This paper introduces an agent-based model that explores the relationships between education, social networks, and support for democratic ideals. This study examines two factors thai affect democratic support, education, and social networks. Current theory concerning these two variables suggests that positive relationships exist between education and democratic support and between social networks and the spread of ideas. The model contains multiple variables of democratic support, two of which are evaluated through experimentation. The model allows individual entities within the system to make "decisions" about their democratic support independent of one another. The agent based approach also allows entities to utilize their social networks to spread ideas. Current theory supports experimentation results. In add~ion , these results show the model is capable of reproducing real world outcomes. This paper addresses the model creation process and the experimentation procedure, as well as future research avenues and potential shortcomings of the mode

Disentangling the influence of knowledge on attribute non-attendance

The data from the cold-water coral survey was collected as part of the project “Habitat-Fisheries interactions – Valuation and Bio-Economic Modeling of Cold-Water Coral”, funded by the Research Council of Norway (Grant no. 216485). We also thank the Marine Alliance Science and Technology (MASTS, www.masts.ac.uk, Scot­tish Fund­ing Coun­cil, Grant no. HR09011) for part funding this research.We seek to disentangle the effect of knowledge about an environmental good on respondents' propensity to ignore one or more attributes on the choice cards in a discrete choice experiment eliciting people's preferences for increased protection of cold-water corals in Norway. We hypothesize that a respondent's level of knowledge influences the degree to which she ignores attributes. Respondents participated in a quiz on cold-water coral prior to the valuation task and we use the result of the quiz as an ex-ante measure of their knowledge. Our results suggests that a high level of knowledge, measured by a high quiz score, is associated with higher probabilities of attendance to the three non-cost attributes, although this effect is only significant for one of them. A higher quiz score is also associated with a significantly lower probability of attending to the cost attribute. Furthermore, although being told your score has mixed directional effects on attribute non-attendance, it does not significantly affect the probability of attending to any of the attributes. Finally, allowing for attribute non-attendance leads to substantially lower conditional willingness-to-pay estimates. This highlights the importance of measuring how much people know about the goods over which they are choosing, and underlines that more research is needed to understand how information influences the degree to which respondents ignore attributes.PostprintPeer reviewe

A Model of Rapid Radicalization Behavior Using Agent-Based Modeling and Quorum Sensing

Understanding the dynamics of radicalization, especially rapid radicalization, has become increasingly important to US policy in the past several years. Traditionally, radicalization is considered a slow process, but recent social and political events demonstrate that the process can occur quickly. Examining this rapid process, in real time, is impossible. However, recreating an event using modeling and simulation (M&S) allows researchers to study some of the complex dynamics associated with rapid radicalization. We propose to adapt the biological mechanism of quorum sensing as a tool to explore, or possibly explain, rapid radicalization. Due to the complex nature of quorum sensing, M&S allows us to examine events that we could not otherwise examine in real time. For this study, we employ Agent Based Modeling (ABM), an M&S paradigm suited to modeling group behavior. The result of this study was the successful creation of rapid radicalization using quorum sensing. The Battle of Mogadishu was the inspiration for this model and provided the testing conditions used to explore quorum sensing and the ideas behind rapid radicalization. The final product has wider applicability however, using quorum sensing as a possible tool for examining other catalytic rapid radicalization events

Redefining Concatenative Speech Synthesis for Use in Spontaneous Conversational Dialogues; A Study with the GBO Corpus

This chapter describes how a very large corpus of conversational speech is being tested as a source of units for concatenative speech synthesis. It shows that the challenge no longer lies in phone-sized unit selection, but in categorising larger units for their affective and pragmatic effect. The work is by nature exploratory, but much progress has been achieved and we now have the beginnings of an understanding of the types of grammar and the ontology of vocal productions that will be required for the interactive synthesis of conversational speech. The chapter describes the processes involved and explains some of the features selected for optimal expressive speech rendering

Vowel-Length Contrasts and Phonetic Cues to Stress: An Investigation of their Relation

The functional load hypothesis of Berinstein (1979) put forward the idea that languages which use a suprasegmental property (duration, F0) contrastively will not use it to realise stress. The functional load hypothesis is often cited when stress correlates are discussed, both when it is observed that the language under discussion follows the hypothesis and when it fails to follow it. In the absence of a more wide-ranging assessment of how frequently languages do or do not conform to the functional load hypothesis, it is unknown whether it is an absolute, a strong tendency, a weak tendency or unsupported. The results from a database of reported stress correlates and use of contrastive duration for 140 languages are presented and discussed. No support for the functional load hypothesis is found

“Music in Mind” and Manchester Camerata: an exploratory qualitative evaluation of engagement in one care home in Northwest England

Purpose The purpose of this paper is to consider the work conducted by Manchester Camerata (an internationally renowned and world-class chamber orchestra) programme for people with dementia in one care home in the north west of England. The study aim was to undertake an exploratory qualitative evaluation of experiences of those taking part in its ten week “Music in Mind” programme, namely care home staff, Manchester Camerata musicians/organisational staff, care home activity workers, the assigned music therapist and visiting family carers. Design/methodology/approach During July-September 2014 a sample of 11 participants was recruited and a total of 19 interviews conducted over ten weeks. All respondents were offered the opportunity to be interviewed more than once. Interview data were supplemented by information gathered at two musicians de-brief sessions and from two activity workers’ diaries. All data was organised using NVivo 10 and thematic analysis applied to the whole data set. People with dementia could not be included in the sample owing to the time limitations on starting and completing the evaluation. Findings This analytical process generated three overarching themes: Making it Happen, which referred to the contextual, structural and organisational considerations necessary for setting up the engagement programme; Orchestrating Person-centred Care, which addressed the importance of building relationships through person to person communication; Making Musical Connections, which identified the sensory and embodied qualities of live music and the need to capture in-the-moment experiences. Originality/value Whilst each of these theme headings has slightly different meanings and applications to each of the participating stakeholders, the evaluation highlights the potential power of improvised music making to equalise and harmonise the group dynamics by co-creating “in-the-moment” experiences